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ABSTRACT 



A system and method for the preparation of data into an 
organized and effective methodology provides users with a 
data modeling tool. Data is confirmed and baseline calcu- 
lations, event extraction, key performance indicator calcu- 
lations and the production of event outputs are performed. 
Analytical tools can then be used to visualize patterns, trends 
and relationships in the data. 
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SYSTEM AND METHOD OF PREPARING AND 
PROCESSING DATA FOR TRADE PROMOTION 

TECHNICAL FIELD OF THE INVENTION 

[0001] The present invention relates to a system and 
method for the preparation of data, and in particular, to a 
system and method of data modeling and processing for a 
trade promotion-effectiveness analysis. 

BACKGROUND OF THE INVENTION 

[0002] Recent studies on trade promotion spending effec- 
tiveness in the consumer products industry have indicated 
that consumer products companies spend more than S25 
Billion on trade promotion and much of this spending is very 
inefficient. This inefficiency is due to manufacturers' lack of 
promotion strategy, purpose, and objectives; their poor vis- 
ibility into post-event performance; their inadequate pro- 
cesses, systems, and data; and the fact that they often 
misunderstand the true costs of promotion. 

[0003] Accordingly, a need exists for a system to guide a 
manufacturer's decisions related to trade promotion. 

SUMMARY OF THE INVENTION 

[0004] In one embodiment of the invention, there is a 
method of processing data. The method includes, for 
example, collecting and transforming consumption data, 
shipment data and event cost data, and aggregating the 
consumption data, shipment data and event cost data into a 
single data file. 

[0005] In one aspect of the invention, the method further 
includes, for example, verifying account and product hier- 
archies in the consumption data to ensure unique account 
identifiers and product identity and characteristics, respec- 
tively, and recording the consumption data such that for the 
account, a UPC (Uniform Product Code) exists for an 
observation, and such that observation characteristics are 
recorded uniformly. 

[0006] In another aspect of the invention, the method 
further includes, for example, rolling the consumption data 
into a sales summary report for viewing by a user. 

[0007] In still another aspect of the invention, the sales 
summary report includes aggregated sales by account, by 
promoted product groups and by account/promoted group 
combinations. 

[0008] In yet another aspect of the' invention, the method 
further includes, for example, mapping the shipment data in 
order to match shipment accounts to syndicated data, and to 
match shipment SKUs (Stock Keeping Units) to promoted 
groups, and checking the shipment data to verify account, 
product and week level uniqueness. 

[0009] In still another aspect of the invention, the method 
further includes, for example, verifying the uniqueness of 
the account, promoted group, start week and duration level 
of the event cost data, and removing events with inconsistent 
information. 

[0010] In another embodiment of the invention, there is a 
method of aggregating data to create a data file for analysis. 
The method includes, for example, inputting consumption 
data, shipment data and event cost data, matching accounts 



and products for the consumption, shipment and event cost 
data, and outputting the data file based on the matching. 

[00U] In one aspect of the invention, the method further 
includes, for example, monitoring the below-baseline per- 
formance of the data for promoted product category sales 
during a specified period following an event, monitoring the 
below-baseline performance of the data for no n- promoted 
products within the promoted products during the event, and 
allocating the shipment data. 

[0012] In still another embodiment of the invention, there 
is a system for processing data. 

[0013] The system includes, for example, a database col- 
lecting consumption data, shipment data and event cost data, 
and a processor transforming and aggregating the consump- 
tion data, shipment data and event cost data into a single data 
file. 

[0014] In yet another embodiment of the invention, there 
is a system for aggregating data to create a data file for 
analysis. The system includes, for example, a database 
storing consumption data, shipment data and event cost data, 
and a processor matching accounts and products for the 
consumption, shipment and event cost data, and outputting 
the data file based on the matching. 

BRIEF DESCRIPTION OF THE DRAWINGS 

[0015] FIG. 1 illustrates one embodiment of the invention 
for promotion value targeting. 

[0016] FIG. 2 illustrates an exemplary integrated, close- 
loop process for a promotion strategy. 

[0017] FIG. 3 illustrates an exemplary embodiment of a 
process in the present invention. 

[0018] FIG. 3A illustrates an exemplary system for the 
present invention. 

[0019] FIG. 4 illustrates an exemplary flow diagram of the 
consumption data confirmation process. 

[0020] FIG. 5 is an exemplary flow diagram of the base- 
line calculation. 

[0021] FIG. 6 is an exemplary flow diagram of an event 
extraction. 

[0022] FIG. 7 is an exemplary flow diagram of shipment 
data processing. 

[0023] FIG. 8 is an exemplary flow diagram of adjusting 
shipment data. 

[0024] FIG. 9 is an exemplary flow diagram of event cost 
data cleansing and confirmation. 

[0025] FIG. 10 is an exemplary flow diagram of bringing 
all processes of the present invention together. 

DETAILED DESCRIPTION OF THE 
INVENTION 

[0026] This invention provides a Sales and Marketing 
Analytical Redeployment Tool (SMART) that helps compa- 
nies address their critical trade promotion issues and drive 
growth. This tool helps manufacturers redeploy their trade 
promotion investments by identifying the least and most 
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productive promotion spends, thus allowing users to quickly 
redeploy funds to drive improvements in both top- and 
bottom-line performance. 

[0027] In particular, the present invention relates to a 
system and method for the preparation of data into an 
organized and effective methodology and provides users 
with a data modeling tool for the same. In this regard, the 
invention seeks to provide an approach for conducting data 
modeling and processing for a trade promotion effectiveness 
analysis. Generally speaking, the system and method of the 
present invention perform data confirmation and transaction, 
baseline calculations, event extraction, key performance 
indicator calculations and the production of event-level 
score cards, as more fully described below. The system and 
method also informs users of the prerequisites necessary to 
perform each process and the exit criteria that should be met 
in order to move to the next process. 

[0028] The primary value "destroyers" for manufacturers 
today are trade promotion inefficiencies. Trade promotion 
strategies are often unclear and even unsound if they exist at 
all. Trade promotion effectiveness is frequently exaggerated, 
as hidden costs are underestimated and benefits are over- 
stated. The present invention, or Sales and Marketing Ana- 
lytical Redeployment Tool ("SMART 13 ), encapsulates the 
processes and tools necessary for the execution of trade 
promotion analysis. The SMART model consolidates three 
major types of information: consumption, shipments and 
event cost. Consumption information is typically extracted 
from the clients' IRI or AC Nielsen provided database. 
Shipment data is obtained from the clients' internal systems, 
and event spending is collected from the clients 5 sales 
organization. This information is then used to construct a 
database of trade events uniformly measured by a set of 
potential "causal" variables and key performance indicators 
(KPls). The event database is then analyzed, as described 
below, to produce the primary drivers of event effectiveness 
(or ineffectiveness). 

[0029] The SMART model also provides the means to 
perform post-event analysis. KPIs can be calculated for each 
event within the model (e.g. spending efficiency, forward 
buying, retailer pass-through, etc.). Additionally, consump- 
tion baselines, pantry loading and cannibalization can be 
calculated with the present invention. Analysis tools are also 
included to visualize patterns, trends and relationships in the 
data, and an analytical process exists to guide the users 
through the analysis. Data mining techniques can also be 
applied to automatically search multiple dimensions for 
complex or non-intuitive hypotheses. 

[0030] Promotion Value Targeting 

[0031] FIG. 1 illustrates one embodiment of the invention 
for promotion value targeting. Promotion value targeting is 
based on closely working with a focused team to conduct 
fact finding, identify value opportunities, drive consensus on 
value piloting and build an execution plan. First is "speed to 
value". Speed to value allows users to leverage their best 
practice databases using the system and method of the 
present invention, and to identify "quick win" opportunities 
and benefits. After the completion of the speed to value 
portion, leadership and alignment beings. This portion of the 
process brings management together for prioritization/con- 
sensus sessions, and contemplates the "quick win'Vpilots. 
Learning and renewal tracks the pilot results and develops 



broad-scale implementation alternatives, as well as utilizes 
the pilots to demonstrate success and build the organization. 
Dynamic business modeling then develops business case 
scenarios (e.g. the size of the opportunity) and explains the 
trade-offs among the implementation alternatives. Finally, 
the capabilities-based promotion strategy prioritizes gaps 
and opportunities and implements value -based programs 
(e.g. fund structures/strategy, processes/policies, systems 
and tools, performance drivers, etc.). 

[0032] FIG. 2 illustrates an exemplary integrated, close- 
loop process for a promotion strategy. Initially, a promotion 
strategy is created by (a) defining the role of trade promotion 
based on category goals, (b) developing trade promotion 
goals/objectives and success metrics, and (c) developing and 
publishing national trade promotion program and guidelines, 
policies and tips for trade promotion. Then, targets are 
developed and funds allocated. This is accomplished by (a) 
denning specific volume, profit and business objectives, (b) 
determining spending needs at the category/account level 
and roll-up to a high-level promotion budget, and (c) estab- 
lishing a spend rate for each case/lb. shipped and by deploy- 
ing additional merchandising funds to regional manager for 
equitable and fair distribution, as needed. Promotion plans/ 
events are then created by (a) using customer/event learning 
to conduct "what if' simulation, (b) developing promotion 
plans by category and account, and (c) documenting, 
approving and changing plans/targets if necessary. Subse- 
quently, 'sell-in7negotiate promotion plans are formed. This 
is accomplished by (a) preparing for customers questions 
and objections, (b) capturing commitments at the customer/ 
event level, (c) discussing payment strategies/options with 
customers, and (d) setting up plans in order entry/invoicing 
systems. Next, payments/deductions resolutions are autho- 
rized by (a) reviewing and verifying event performance vs. 
commitments and authorizing payments to customers, (b) 
receiving open deductions from accounts receivable and 
matching them to promotion commitments, and (c) clearing 
"matched" deductions in accounts receivable and sending 
payment authorizations to accounts payable. Plans are 
tracked versus actuals and then accounted for. This occurs 
by (a) tracking shipments and consumption, revenue, pro- 
motion spending and profitability against the plan, (b) con- 
ducting store checks/monitoring retail activities, (c) revising 
plans to meet new customer and business demands, as 
necessary, and (d) reviewing and monitoring trade accruals 
and capturing customer/event learnings. Finally, promotion 
effectiveness is evaluated. Evaluation occurs by (a) gather- 
ing trade promotion results and evaluating promotion effec- 
tiveness, (b) reviewing performance metrics and determin- 
ing root causes of under- and over-performance, (c) 
documenting and sharing learnings, and (d) reviewing lan- 
guage with customers and identifying impact on future 
plans. 

[0033] Data Modeling and Transformation 

[0034] FIG.-3 illustrates an exemplary embodiment of a 
process in the present invention. In the preferred embodi- 
ment, there are three categories of data used to construct a 
historical event file — each having a process for data prepa- 
ration and verification. These three categories of data 
include, but are not limited to, consumption data, shipment 
data and event cost data. Generally speaking, consumption 
data includes information about accounts, products, sales 
and promotion activity (e.g., ad, display, etc.); shipment data 
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includes information about when, how much and at what 
price a product was sent to a retailer; and event cost data 
includes event spendiag information. Of course, other 
sources of data (e.g., media and consumer activity, demo- 
graphic information, etc.) may also be used. 

[0035] The present invention includes the following pro- 
cesses that are involved in the transformation of consump- 
tion, shipment and event cost data into an output file (i.e. 
historical event file). More specifically, the transformation of 
data includes consumption data process 5, shipment data 
process 25 and event cost data process 40. Consumption data 
process 5 includes consumption data confirmation 10, base- 
line calculation 15 and event extraction 20. Shipment data 
process 25 includes shipment data confirmation and adjust 
shipment data 35. Event cost data process 40 includes event 
cost data cleansing and confirmation 45 and event aggrega- 
tion 50. In the preferred embodiment, these processes are 
independent from one another and may be executed indi- 
vidually or in parallel. In the consumption data transforma- 
tion process 5, weekly "UPC" ("Uniform Product Code" or 
individual item) level consumption data is first cleansed and 
verified, as described below. Baselines may need to be 
recalculated to accurately reflect incremental volume. 
Events can be extracted based upon merchandising activity. 
For shipment data preprocessing 25, the data is first 
cleansed, verified and mapped to accounts and promoted 
product groups for later merging with the consumption data. 
The event cost data process 40 provides a consistent record 
of event spending, which may require some standardization 
of pricing strategies and cost reporting. Ultimately, data 
elements are aggregated into a single table of events to be 
used in the overall analysis. A more detailed discussion of 
each process is described below. 

[0036] FIG. 3 A illustrates an exemplary system for the 
present invention. The system includes, for example, 
account, product and cost data; data preprocess/transforma- 
tion storage, which can store confirmation reports and 
graphs; a database for storing data sets, including events and 
which outputs scorecards, summary reports and graphs; a 
SMART tool (e.g. an interface that allows a user to execute 
the various tools implemented by the system); and a MDDB 
(mulli -dimensional database), which outputs a multi-dimen- 
sional drilldown tool. 

[0037] FIG. 3B is an exemplary flow diagram of the 
analysis approach of the present invention. The analysis 
approach includes, for example, calculating event spending, 
scorecards and reports and graphs; creating analytical 
groups; summarizing performance by group; developing 
hypotheses; testing/analyzing hypotheses; summarizing 
findings; profiling events; and conducting automated analy- 
sis. This is more fully described below. 

[0038] Consumption Data 

[0039] FIG. 4 illustrates an exemplary flow diagram of the 
consumption data confirmation process- The consumption 
data confirmation process 10 includes, for example, input- 
ting consumption data at the UPC-level 55; verifying record 
uniqueness by account, week and product 60; checking data 
consistency 65; aggregating the data to a higher level 70 and 
outputting consumption data by account, product and 
account/product 75. Consumption data confirmation pro- 
cessing 10 confirms the input data, performs accurate base- 
line estimation and extracts events. As depicted in FIG. 4, 



the main input of the consumption data processing (at 55) is 
weekly UPC-level sales and merchandising information 
from a syndicated data provider such as IRI or AC Nielsen. 
The main output of consumption data processing (at 75), on 
the other hand, is a "clean" set of promoted product group 
sales and merchandizing characteristics for events. "Clean" 
in the context of this consumption data processing refers to 
the verification, checking and aggregation of data in process 
10. 

[0040] Consumption data confirmation process 10 
involves verification of account and product hierarchies, 
observation uniqueness and measurement consistency. A 
"source consumption data set", i.e., a set of consumption 
data received from multiple syndicates, or syndicated con- 
sumer data, is input into the consumption data confirmation 
process 10, and results in a "data confirmation report" which 
allows the integrity of the data to be confirmed. The account 
hierarchy includes unique account identifiers such as 
account names or account IDs. Each account will have 
attributes such as geographic region, pricing policy (e.g. 
ED LP), etc. Similarly, the product hierarchy can uniquely 
identify each product and its characteristics (UPC, category, 
brand, promoted group, etc.) (e.g., "Six pack of XYZ 12 oz 
fight beer cans" UPC, "light beer" category, "XYZ" brand, 
and "Premium Beer" promoted group). The correct estab- 
lishment of these hierarchies ensures that other data sources 
will merge properly with each other. Observation unique- 
ness means that within a given account, each UPC should 
exist in one observation per week. If records are missing for 
certain weeks, they should be replaced with zero or null 
observations. If duplicates exist, they are purged in the 
preferred embodiment. Measurement consistency, on the 
other hand, means that observation characteristics should be 
recorded uniformly. For example, ratios should not some- 
times be recorded in decimal form and sometimes as per- 
centages. 

[0041] Upon completion of the consumption data confir- 
mation process 10, the data may then be used to create a 
sales summary report for final client confirmation. The data 
will be used to create a report that will show, for example, 
aggregated sales by accounts, by products and by account/ 
product combinations. The report, including the aggregated 
data, should be more familiar to the client than detailed UPC 
level time series data and allow the client to verify the 
accuracy and magnitudes of the aggregated sales values 
more easily. 

[0042] The consumption data confirmation process 10 
performs the following: 

[0043] Calculates a total sales summary by 
account — This summary can be viewed online or 
exported to a file for further formatting. 

[0044] Calculates a total sales summary by promoted 
group — This summary can be viewed online or 
exported to a file for further formatting. 

[0045] Calculates a total sales summary by account/ 
promoted group — This summary can be viewed 
online or exported to a file for further formatting. 

[0046] Calculates a base sales time series by account/ 
promoted group — This summary will be extracted 
for use in, for example, the Excel Time Series Tool. 
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[0047] Prior to performing the consumption data confir- 
mation process 10, various data is collected, such as con- 
sumption IRI data such as account, product, % ACV, dollar 
sales, base sales, unit sales, dates, etc.; account data such as 
account, account type, customer, region, etc.; and product 
data such as product, promoted group, category, brand, 
division, etc. %ACV, or percent all commodity volume, 
refers to the weighted percentage of sales volume sold under 
a trade promotion event at a given retail account within a 
given market. 

[0048] The data should meet the following requirements 
and should be checked for uniqueness, completeness, and 
consistency: 

[0049] Records should be unique by account, prod- 
uct, and week. 

[0050] Product and account names should match the 
IRI names. 

[0051] IRI %ACV values should be consistent, i.e., 
either all should be expressed as a whole number or 
a decimal number, and should be between 0% and 
100%. 

[0052] IRI week dates should be consistent, i.e., week 
ending dates should be on a Sunday, and the weeks 
that are to be included in the analysis should be 
included. 

[0053] Users should review and confirm summary 
data. 

[0054] Baseline Calculation 

[0055] After completion of the consumption data confir- 
mation process 10, a baseline calculation 15 is made. FIG. 
5 is an exemplary flow diagram of the baseline calculation. 
The baseline calculation 15 accepts the verified consumption 
data set (and product data) 80 as an input, and outputs a 
consumption data set with a new baseline at 105. The 
baseline calculation ensures the accurate calculation of 
incremental volume. If suitable baselines are not provided in 
the syndicated data (i.e. IRI or AC NeiLson data), the 
baselines are estimated within the model. Consumption and 
product data 80 are input into the baseline calculation 15, 
and the event weeks are marked at 85 at the product level for 
the non-competitor data. Once the event weeks are marked 
at 85, the base consumption for the event weeks is projected. 
The projected base consumption is then used to calculate the 
baseline for the whole period at 100, and consumption data 
with a new baseline is output at 105. 

[0056] The present invention provides the capability to 
estimate the actual baseline volume for each UPC time 
series using the consumption levels reported in the syndi- 
cated data. Actual promoted sales observations in the syn- 
dicated data are replaced with the non-promoted mean sales 
foreach UPC to eliminate the effects of the promotion. A 
new baseline is then forecast from the adjusted time series 
using an exponential smoothing technique, and spikes in the 
new baseline are removed with a 5 week moving average (of 
course, this number can be varied), in the preferred embodi- 
ment. This technique is especially well-suited for products 
that have week or no seasonality. For more seasonal prod- 
ucts, further adjustments can be made to smooth out the 
effects of seasonality. 



[0057] The baseline calculation process performs the fol- 
lowing: 

[0058] Select non-competitor data at account, prod- 
uct, and week level from master 1 data. 

[0059] Mark the event weeks at the product level for 
the non-competitor data. 

[0060] Calculate the consumption baseline using 
exponential smoothing for the marked event weeks. 

[0061] Prerequisites to performing the above process 
include, for example, a master data set 1 — with hierarchy 
and a data set which includes the consumption data with the 
account, product and time hierarchy. Prerequisites for the 
master data set 1 include, for example, consumption IRI data 
such as account, product, % ACV, dollar sales, base sales, 
unit sales, dates, etc.; account data such as account, account 
type, customer, region, etc.; product data such as product, 
promoted group, category, brand, division, etc.; and time 
data such as season, season/year, week, etc. 

[0062] Records should be unique by account, promoted 
group, week, and new baseline sales (sales without any 
promotions) and incremental sales are recalculated using 
exponential smoothing. Upon the completion of the newly 
calculated baseline, a second master data set is created. This 
set (master data set 2) includes the master data set 1 and the 
newly calculated consumption baseline data. 

[0063] Event Extraction 

[0064] Event extraction 20 occurs after the consumption 
data has been checked and verified. Event extraction 20 is 
independent of the baseline calculation 15. FIG. 6 is an 
exemplary flow diagram of an event extraction. Generally 
speaking, the process identifies and marks event weeks by % 
ACV at the promoted group level, and then assigns event Ids 
to the marked weeks and generates an all events data set. 
Specifically, consumption and product data are input at 110, 
and event weeks are marked according to %ACV at the 
promoted group level at 115. The marked events are then 
bound with the start week/end week by account/promoted 
group at 120, and events are output as a consumption data 
set aggregated to the event level at 125. 

[0065] Promotion events are extracted (or identified) in the 
syndicated data based upon the presence of merchandising 
activity (also referred to as causal activity), unless accurate 
event calendars are provided. Where this activity is detected, 
an event is identified. Incremental volume is not used to 
identify events, and therefore does factor into the baseline 
calculation. Typically, several types of merchandising activ- 
ity are reported in the syndicated data with some indication 
of their level of intensity. For example, IRI uses four 
mutually exclusive types: Feature Only, Display Only, TPR 
Only and Feature and Display. The intensity level is mea- 
sured as a percentage of the stores* ACV in the account 
under which this activity occurred. Activity intensity thresh- 
olds are used to detect when a promotion was run (e.g. 40% 
ACV Feature Only) and each observation that meets or 
exceeds the specified thresholds is flagged as an event week 
(115). 

[0066] Event extraction performs the following process: 

[0067] Sales (total consumption) are grouped by 
account/promoted group. 
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[0068] UPC-level data is rolled-up to the promoted 
group level. 

[0069] Event weeks are marked in the account/pro- 
moted group data. 

[0070] Event IDs are assigned to marked weeks. 

[0071] n event table is generated outlining all the 
extracted events. 

[0072] Additionally, during event extraction the following 
processing occurs: 

[0073] Thresholds set for causal activity allow the 
event extraction process to identify and mark those 
promoted groups and weeks where event activity 
occurred (e.g., If %ACV>40%, a promotion event is 
marked). 

[0074] Data for the promoted groups is aggregated 
with event activity for the promotion event. The 
causal activity is averaged and all other numeric 
variables are summed-up for the duration of the 
event. 

[0075] These events, which are defined by account, 
promoted group, start week, and duration, are then 
assigned unique identifiers. 

[0076] Numeric variables are summed-up over time, 
and an average, minimum and maximum %ACV for 
the promotion types is calculated. Event extraction is 
also used to match the event calendar from the 
division to the data from the event extraction process 
before the data is rolled-up to the event level and 
shipments are allocated. Also, cannibalization and 
pantry loading are taken into account, as described 
below. 

[0077] Shipment Data Processing 

[0078] FIG. 7 is an exemplary flow diagram of shipment 
data processing. Shipment data 25, which is obtained from 
users' internal systems, and is mapped in order to match the 
shipment accounts to the IRI accounts and the shipment 
SKUs to the promoted groups at 130 and 135. The data is 
then checked for uniqueness at the account, product (UPC), 
week level (140) and then rolled up to the account, promoted 
group and week level for further processing at 145 and 150. 

[0079] More specifically, shipment data confirmation 30 
includes the following process: 

[0080] Map shipment accounts to IRI account- RMA. 
"Mapping" involves linking internal company ship- 
ment information to the syndicated consumption 
data. 

[0081] Map shipment SKU to promoted groups. 

[0082] Roll shipment data to account, promoted 
group, and week level; 

[0083] Merge shipment data with calendar data to 
obtain season information. 

[0084] Calculate average of cost of goods sold 
(COGS) and list price to retailer by promoted group. 

[0085] Impute COGS and list price to their respective 
promoted groups. 



[0086] Calculate total shipments by account, pro- 
moted group. 

[0087] Match the consumption volume to the ship- 
ments and calculate the shipment conversion factor 
(for differences in size between the company and 
syndicated shipment regions). This factor equals the 
amount of consumption divided by the amount 
shipped. 

[0088] Adjust shipment data with conversion factor. 

[0089] Prerequisites to performing the above process 
include, for example: 

[0090] Shipment Data: shipment account, shipment 
products name, number of units shipped or returned 
by week, week dates, COGS, etc. 

[0091] Shipment Account Map: shipment account, 
and account- RMA. 

[0092] Shipment Product Map: shipment product 
name and promoted group. 

[0093] Time Data: season, season/year, week, etc. 

[0094] The resultant data should meet the following 
requirements and should be checked for uniqueness, com- 
pleteness, and consistency: 

[0095] Shipments should be unique by account, prod- 
uct, and week. 

[0096] Shipments should be aggregated to account, 
promoted group, and week level for merging with the 
events 

[0097] Shipments should be in terms of the same 
units (i.e., cases, pounds) as the rest of the data. 

[0098] Ship week dates should match the time data 
week dates. 

[0099] Upon completion of this process, a master data set 
3 is calculated. Master data set 3 includes the master 2 data 
matched to the shipment data. Prerequisites to the creation 
of the master data set 3 include master data set 2 and the 
adjusted shipment data, as described below. Also created is 
master data set 4. Master data set 4 includes master data set 
3 data, competitor market data (e.g. account, promoted 
group and competitive market), consumer activity (e.g. 
account, promoted group, week and consumer activity), 
media activity (e.g. account, promoted group, week and 
media activity), substitutable group data (promoted group, 
substitutable group and region) and calendar data (e.g. 
season, month position, special days and week). 

[0100] Competitive activities may then be extracted from 
the consumption data and rolled-up to the account/category 
level The competitor event weeks are then marked with 
product % ACV causal. In order to accomplish this, certain 
data is required including, for example, the master data set 
1 — with hierarchy and the competitive activity "data, such as 
account, category, % ACV, week, and equivalized unit sales. 
The data that is output should be checked for uniqueness, 
completeness, and consistency. That is, records should be 
unique by account, category, and week. 

[0101] Subsequently, master data set 5 is created by incor- 
porating the master 4 data and competitor event data. The 
newly formed set of data should meet the following require- 
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menls and should be checked for uniqueness, completeness, 
and consistency: records should be unique by account, 
product, and week, and additional records should not be 
created as a result of the merge of data. 

[0102] FIG. 8 is an exemplary flow diagram of adjusting 
shipment data. Shipment data is adjusted at 35. Initially, the 
shipment volume (155) is matched to the consumption 
volume (160) at 165 in order to calculate the conversion (i.e. 
adjustment) factor (adjustment factor=consumption/ship- 
ment) needed to adjust the shipment volume to the con- 
sumption level (170). Then the cost of goods sold (COGS) 
and list price by season/year combination are imputed (175). 
This calculation results in the adjusted shipment data at the 
Account/Promoted Group Level (185). 

[0103] FIG. 9 is an exemplary flow diagram of event cost 
data cleansing and confirmation. Event cost cleaning and 
confirmation 45 occurs as follows. Event cost data 40 is 
checked in order to verify its uniqueness at the account, 
promoted group, start week and duration level at 185. Then, 
events with inconsistent data (i.e. overlapping events or 
events with missing account, promoted group, week, dura- 
tion and fixed or variable cost data) are removed at 190, the 
consistency of measures (e.g., price per unit, COGS per unit 
is then checked at 195, and clean event cost data is output 
at 200. 

[0104] The clean cost data process performs the following: 

[0105] Assigns an event ID to each event 

[0106] Removes events with missing data (i.e. miss- 
ing account, promoted group, start week, duration 
and fixed or variable cost). 

[0107] Removes overlapping events. 

[0108] Checks the consistency of measures 

[0109] Event data such as account, promoted group, dura- 
tion, start week, fixed and variable cost, etc. are prerequisite 
to performing the clean cost data process. 

[0110] The data should meet the following requirements 
and should be checked for uniqueness, completeness, and 
consistency according to the following: 

[0111] Records should be unique by account, pro- 
moted group, and week. 

[0112] Units (i.e., cases, pounds, etc.) should be the 
same as the rest of the data. 

[0113] Events should be actual events, i.e., there 
should be a start week, a duration>-l, and 
%ACV>0. 

[0114] The week dates should be consistent, i.e., 
week ending dates should be on a Sunday, and the 
weeks that are to be included in the analysis should 
be included. 

[0115] FIG. 10 is an exemplary flow diagram bringing all 
processes of the present invention together. "Event Aggre- 
gation" occurs at 50, where consumption data 5, shipment 
data 25 and event cost data 40 are matched (205). During 
this process the consumption data 5, shipment data 25, and 
event cost data 40 are pulled into the model and matched 
based upon common elements such as account, promoted 
group, start week and duration. Once data is matched at 205, 



pantry loading, cannibalization and KPIs can be calculated. 
Event Summaries 225 and Event Scorecards 230 can be 
created from the data. A more detailed description is pro- 
vided below. 

[0116] Pantry Loading and Cannibalization Lift Adjust- 
ments 

[0117] Pantry loading and cannibalization result in illu- 
sory increases in product consumption brought about by a 
promotional event. This increase in quantity demanded 
without a corresponding increase in product demand mani- 
fests itself as a temporary decrease in future consumption of 
the product category (pantry loading affect) and a temporary 
decrease in the current of substitutable products within the 
product category (cannibalization affect). In order to evalu- 
ate correctly the "true" impact of trade promotion on sales, 
a nominal lift must be adjusted for these affects. Therefore, 
the "True" Lift=Nominal Lift31 Pantry Loading- Cannibal- 
ization. 

[0118] Substitutable groups are used to determine if can- 
nibalization or pantry loading occurred because of a pro- 
motion event. Base and actual sales are calculated by 
substitutable group, and then summed up to the event level. 
If actual sales dipped below the base sales during a week in 
which there was an event or events, then the cannibalized 
sales are noted and the sales are equally distributed among 
the weeks during and after the promotion events, if there was 
more than 1 event. If actual sales dipped below the base sales 
during the 2 weeks following an event or events, then the 
pantry loading sales are noted — again equally distributing 
the sales among the surrounding weeks if there was more 
than 1 event. 

[0119] Pantry loading can be detected by monitoring the 
below baseline performance of product category sales dur- 
ing some specified period immediately following a given 
event. The choice of the evaluation period should be product 
category specific. Cannibalization can be detected by moni- 
toring the below baseline sales performance of non-pro- 
moted products within the category of the promoted prod- 
ucts during the event. Some issues due arise with the 
existence of events with back-to-back or overlapping evalu- 
ation periods that involve products in the same category. 

[0120] The data should meet the following requirements 
and should be checked for uniqueness, completeness, and 
consistency: 

[0121] Records should be unique by account, prod- 
uct, and week. 

[0122] Products should have the correct associated 
information. Promoted group and substitutable 
group are required, and other information, such as 
category, is optional. 

[0123] Accounts should have the correct associated 
information, such as region. 

[0124] %ACV values should be consistent, i.e., either 
all should be expressed as a whole number or a 
decimal number, and should be between 0% and 
100%. 

[0125] %ACV for any merchandising-sum of all 
%ACV for promotions (except FSP (Frequent Shop- 
per Programs). 
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[0126] Sales data should be included. 

[0127] The week dates should be consistent, i.e., 
week ending dates should be on a Sunday, and the 
weeks thai are to be included in the analysis should 
be included. 

[0128] Any account/product combinations without 
any sales should be excluded from the data. 

[0129] Any competitor (or division, if extracting 
competitor events) account/products should be 
excluded from the data. 

[0130] Any promoted groups marked "DO NOT 
INCLUDE/* should be excluded from the data. 

[0131] Finally, a KPI calculation is performed, which does 
the following: 

[0132] Expands the events from account, promoted 
group, week, duration level to account, promoted 
group, and week level. 

[0133] Creates a final event table with the expanded 
events and calculated KPIs. 

[0134] To accomplish this, the KPI calculation uses the 
following data: cleaned event cost daia such as account, 



promoted group, duration, start week, fixed and variable 
cost, etc. Records that are output have a unique event ID. 

[0135] Create Analysis Data 

[0136] At the conclusion of the above processes, analysis 
data is created at 225 and 230 as follows: 

[0137] An Event Base Table is created: This prelimi- 
nary table is generated for the MDDB (multi-dimen- 
sional database) building process. The MDDB will 
then be used to create online reports. 

[0138] A Score Card Table is created: This event 
summary table will be used to generate the Event 
Level Score Cards using, for example, SAS Enter- 
prise Reporter. 

[0139] A Report Table is created: This summary table 
will be used to generate reports using, for example, 
SAS Enterprise Reporter. 

[0140] A Graph Table is created: This summary table 
will be used to generate graphs using, for example, 
SAS Enterprise Reporter. 



Data Models 



NAME LABEL Description 



Consumption Data Tabic 

ACC Account- RM A Account name at RMA level 

ACVA % ACV of any promo % ACV coverage under any promo 
PM 

ACVD % ACV of Display % ACV coverage under Display 
P 

ACVF % ACV of Feature % ACV coverage under feature 

ACVF % ACV of Feat & % ACV coverage under Feature and Display 

DP Disp 

ACVFS % ACV of FSP % ACV coverage with Frequent Shopper Program 
P 

ACVP % ACV of TPR % ACV coverage under TPR 
R 

BSD Base Dollars total dollar sales baseline. 

BSDSH Base Dollar Share Percentage, Base dollar share in the category 

BSEQ Base Eq. Units total equivaiized unit sales baseline 

BSEQS Base Eq Unit Share Percentage, Eq. Unit base market share in the category. 

H 

DINC Dollar Increment Incremental $ Sales under any promo, no exist in Bacon 

DS Dollar Sales total dollar sales 

DSFH Dollar Share Percentage, $ Share in the category 

EQINC Eq. Unit Increment Incremental Equivaiized Unit (Lb) volume sales under any promo 

EQP Eq Unit Price average equivaiized unit price in the week, including both promo 

& non-promo prices 

EQPAP Eq Unit Price Any average equivaiized unit price in the week with any promo activity 

M Promo 

EQPNP Eq Unit Price No average equivaiized unit price without any promo 

M Promo 

EQS Eq Unit Sales total equivaiized unit sales 

EQSAP Eq Unit Sales Any Eq Unit Sales Disp + Eq Unit Sales Feat Disp + Eq Unit Sales 

M ' Promo ' " Feat 't Eq Unit Sales TPR " ~ 

EQSDP Eq. Unit Sales Disp equivaiized unit sales with display only 

EQSF Eq. Unit Sales Feat equivaiized unit sales with feature only 

EQSFD Eq. Unit Sales Feat equivaiized unit sales with feature and display 

P Disp 

EQSH Eq Unit Share Percentage, Equivaiized unit share in the category 

EQSHI Eq. Unit Share Incremental market share of pounds in the category 

NC Increment 

EQSPR Eq. Unit Sales TPR equivaiized unit sales with TPR only 
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-continued 



Data Models 



NAME LABEL Description 



PCTAC 


Pet ACV 


The % of stores that scan the product weighted by the size of store 


V 




(ACV) 


PDI 


Product Development 


Product Development Index: (eq unit in market/population in 




Index 


market)/(eq unit in total US/Population in US) 


PDNM 


Product Name & 


product name/description 




Description 




UINC 


Unit Increment 


Incremental unit sales under any promo 


UP 


Unit Price 


average unit price in the week, including promo & non-promo 






price 


UPC 


UPC 


UPC of the product 


US 


Unit Sales 


total unit sales, no exist in breakfast sausage 


USH 


Unit Share 


Percentage, Unit share in the category 


WK 


Week Ending Date 


Week ending date 


YRAC 


Annual_ACV__2MM 


Total Market (Account) size: Annual ACV volume($) for stores 


VM 




over 2MM revenue 


Account Data Table 





ACC 

ACCTYPE 
CUS 

REGION 
Product Data Table 



Account- RMA 
Account Pricing Type 
Customer (account w/out 
RMA) 
Region 



Account name at RMA level 
Account Pricing Type 
Customer name of the account 

market region 



BD 


Brand 


Product brand 


CAT 


Category 


Product category 


DIV 


Division 


Division 


PCKGSZ 


Package Size 


Package Size 


PDNM 


Product Name & Description 


Product name/description 


PKGUN1T 


Package Size Unit 


Package Size Unit 


PROMGRP 


Promoted Group 


Product promotion group 


PROMGRP 

-i 


Original Promoted Group 


Original Promoted Group 


Shipment Data Table 




COGS 


COGS per Eq Unit 


cost of goods sold per Eq. Unit 


EOSfflP 


Eq. Unit Ship 


Number of Eq. Unit Shipments 


LSP_RT 


List Price to Retailer 


Price per Eq. Unit selling to the retailer 


PSHIP 


Shipment Price per 


Shipment Price per Eq. Unit 




Eq. Unit 




SHIPPR 


Shipment Product 


Shipment Product Name 


OD 


Name 




SHIP _A 

CC 


Shipment Account 


Shipment Account 


WK 


Week Ending Date 


Week ending date 



Shipment/ Account- RMA Map Table 



ACC Account- RMA 

SHI P__A CC Shipment Account 
Shipment/Product Map Table 



Account name at RMA level 
Shipment Account 



PROMGRP Promoted Group Product promotion group 

SHIPPROD Shipment Product Name Shipment Product Name 

Time Data Table 



SEASON Season of the Year 

SEAYR Year and Season 

MOPOS Month Position 

SPDY Special Days, such as Holiday 

WK Week Ending Date 

Event Cost Data Table 



spring, summer, fall, winter 
Year and Season 

the week is Beginning, or Ending of Month 
Holiday, back to school, etc. used for Analysis 
Week ending date 



ACC 


Account- RMA 


COMM 


Comments 


DUR 


Duration 


EVDESC 


Event Description 


FX_PRM 


Fixed Promotion 


C 


Cost 


IMPEID 


Imported Event ID 


PROMG 


Promotion Group 


RP 




PSTRAT 


Pricing Strategy 



Account name_at _RMA level _ 

Commenting on discrepancies for Cost Data Cleaning 
Length of event in # of weeks 
Event Description 
Fixed Cost of Promotion 

Imported Event ID 
product promotion group 

Pricing strategy during promotion 
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Data Models 



NAME 



LABEL 



Description 



SDEMO 
SWK 
VAR^PR 
MC 



In Store Demo? 
Start Week 
Variable 
Promotion Cost 



Competitor Market Data Table 

ACC Account- RMA 

COMP_MKT Competitive Market 
PROMGRP Promoted Group 
Media Activity Data Table 



ACC 
MEDIAT 
PROMGRP 
WK 



Account-RMA 
Media Activity 
Promoted Group 
Week Ending 
Date 



Consumer Activity Data Table 

ACC Account-RMA 
CSAT Consumer Activity 

PROMGRP Promoted Group 
WK Week Ending Date 

Substitutable Group Data Table 

PROMGRP Promoted Group 
REGION Region 
SUBGRP Substitutable 
Group 

Competitive Activity Data Table 



ACC 

ACVAPM 

ACVDP 

ACVF 

ACVFDP 

ACVFSP 

ACVPR 
CAT 
EOS 
WK 



Account-RMA 

% ACV of any promo 

% ACV of Display 

% ACV of Feature 

% ACV of Feat & Disp 

% ACV of FSP 

% ACV of TPR 
Category 
Eq Unit Sales 
Week Ending Date 



Was a demo present in the store (y or n)? 
Week of Event Beginning 
Variable Cost of Promotion 



Account name at RMA level 
Dominant Competitor in the market 
product promotion group 



Account name at RMA level 
Any major media campaign going on 
product promotion group 
Week ending date 



Account name at RMA level 

Any major consumer promo activity going 

product promotion group 

Week ending date 



product promotion group 
market region 

All products in the same group arc considered as substitutable. 
This information will be used in pantry load, cannibalization 
adjustment. 



Account name at RMA level 
- % ACV coverage under any promo 
% ACV coverage under Display 
% ACV coverage under feature 
7o ACV coverage under Feature and Display 
% ACV coverage with Frequent Shopper 
Program 

% ACV coverage under TPR 
Product category 
total equivalized unit sales 
Week ending date 



[0141] Key Performance Indicators (KPIs) for Post-Event 
Analysis 



Core Measures 

Spending Efficiency Reflects profit as a % of spending (Norn Incr Cons x Contr/Unit) - (Cann Cons x Cannibalized Contr/ Unit) 

Total Event Spending 

% Lift Overall % increase in sales from the promotion "True" [ncremental Consumption 

Baseline Consumption 

Incremental Revenue Incremental revenue generated during the promotion [(Total Cons, x Negotiated List Price/Unit) - (Cann Units x Cann 

period — -- List Price/Unit)] —(Base Cons, x- Everyday Tjst-Price/Unit) _ 

Incremental Profit Incremental profit generated during the promotion [("Nominal" Incr Cons x Contr/Unit) - (Cannibalized 

period Cons x Cannibalized Contr/Unit)] - Tot Event Spending 

Supporting Measures 

Cost per Incremental Cost of each incremental unit sold during a Total Event Spending 

Unil promotional event -True" Incremental Consumption 
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Profit per Incremental 
Unit 



Profit gc Derated by each incremental unit during an 



Incremental Profit 



True" Incremental Consumption 



Weighted Weeks of 
Support 

Pass-Through 



Retailer Margin 



Number of weeks of support (e.g., feature, display, # of Weeks Duration x % ACV Any Merchandising 
TPR) provided by the average store 

Percentage of promotion dollars given to account (Baseline Price - Avg. Promoted Price) x Total Cons, 
which is passed through as a lower Total Event Spending 

consumer price 



Margin made by the account during the deal 



Average Promoted Price - Negotiated List Price 
Average Promoted Price 



Total Revenue 
Total Profit 



Dollar Market Share 



Tbtal revenue generated during the promotion period Total Consumption x Negotiated List Price/Unit 
Total profit generated during the promotion period (Total Consumption x Contribution/Unit) - Total Event 

Spending 

Average dollar market share during the promotion Sum of Weekly Share for Promotion Period 
P eriod # of Weeks Duration 



Forward Buy % of shipments that are not consumed (i.e., forward (Total Shipments - Total Consumption) 

bought) during the period Total Shipments 



Forward Buy Cost Lost revenue due to forward buy activity 



(Total Shipments - Total Consumption) x 
'Variable Cost per Unit) 



[0142] Although the present invention has been described 
in detail, it is clearly understood that the same is by way of 
illustration and example only and is not to be taken by way 
of limitation. 

What is claimed is: 

1. A method of processing data, comprising: 

collecting and transforming consumption data, shipment 
data and event cost data; and 

aggregating the consumption data, shipment data and 
event cost data into a single data file. 

2. The method of claim 1, further comprising: 

verifying account and product hierarchies in the consump- 
tion data to ensure unique account identifiers and 
product identity and characteristics, respectively; and 

recording the consumption data such that for the account 
a UPC exists for an observation, and such that obser- 
vation characteristics are recorded uniformly. 

3. The method of claim 2, further comprising: 

rolling the consumption data into a sales summary report 
for viewing by a user. 

4. The method of claim 3, wherein the sales summary 
report includes aggregated sales by account, by products and 
by account/product combinations. 

5. The method of claim 1, further comprising: 

mapping the shipment data in order to match shipment 
accounts to syndicated data, and to match shipment 
SKUs to promoted groups; and 

checking the shipment data To verify account-, promoted 
group- and week-level uniqueness. 

6. The method of claim 1, further comprising: 

verifying the uniqueness of the account-, promoted 
group-, start week- and duration-level of the event cost 
data; and 

removing events with inconsistent information. 



7. A method of aggregating data to create a data file for 
analysis, comprising: 

inputting consumption data, shipment data and event cost 
data; 

matching accounts and products for the consumption, 
shipment and event cost data; and 

outputting the data file based on the matching. 

8. The method of claim 7, further comprising: 

monitoring the below baseline performance of the data for 
promoted product category sales during a specified 
period following an event; 

monitoring the below baseline-performance of the data 
for non-promoted products during the promoted prod- 
uct event; and 

allocating the internal shipment data to its respective 
syndicated consumption data. 

9. A system for processing data, comprising: 

a database collecting consumption data, shipment data 
and event cost data; and 

a processor transforming and aggregating the consump- 
tion data, shipment data and event cost data into a 
single data file. 

10. A system for aggregating data to create a data file for 
analysis, comprising: 

a~d atabase" stofirig'co nsumption data," shipment data and 
event cost data; and 

a processor matching accounts and products for the con- 
sumption, shipment and event cost data, and outputting 
the data file based on the matching. 

* * * * * 
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